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Description 

Method of providing a reliable server function in support of 
a service or a set of services 

5 

The invention relates to a method of providing a reliable 
server function in support of a service or a set of services, 
such as internet-based applications. 

10 To increase availability and reliability for accessing serv- 
ices provided via server-based functions, for example inter- 
net-based applications, it has become increasingly popular to 
provide a pool of servers instead of only one server. Each of 
the servers of the Server Pool, called Pool Elements, is ca- 

15 pable of supporting the requested service or set of services. 

In order to support high performance, availability and scal- 
ability of the applications it is required to keep track of 
what servers are in the pool and are able to receive requests 

20 and a way for the client to bind to a desired server. These 
topics are discussed in the IETF (Internet Engineering Task 
Force) Working Group xx Reliable Server Pooling", called the 
RSerPool working group. An architecture for reliable server 
pooling is being standardized within this working group, see 

25 for example the definition of a reliable server pooling 

fault-tolerant platform described in Tuexen et al., ^Archi- 
tecture for Reliable Server Pooling" , <draf t-ietf-rserpool- 
arch-07 . txt>, October 12, 2003. 

30 RSerPool defines three types of architectural elements: 

Pool Elements (PEs) : servers that provide the same service 
within a pool; 

Pool users (PUs) : clients served by PEs; 
- ■ Name Servers (NSs) : servers that provide the translation 
35 service to the PUs and monitor the health of PEs. 
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In RSerPool, pool elements are grouped in a pool. A pool is 
identified by a unique pool name. To access a pool, the pool 
user consults a name server. 

5 Figure 1 schematically outlines the known RSerPool architec- 
ture. Before sending data to the pool (identified by a pool 
name) , the pool user sends a name resolution query to the 
name (or ENRP, see below) server. The ENRP server resolves 
the pool name into the transport addresses of the PEs . Using 
10 this information, the PU can select a transport address of a 
PE to send the data to. 

RSerPool comprises two protocols, namely, the aggregate 
server access protocol (ASAP) and the endpoint name resolu- 

15 tion protocol (ENRP) . ASAP uses a name-based addressing model 
which isolates a logical communication endpoint from its IP 
address (es). The name servers use ENRP for communication with 
each other to exchange information and updates about server 
pools. The instance of ASAP (or ENRP) running at a given en- 

20 tity is referred to as ASAP (or ENRP) endpoint of that en- 
tity. For example, the ASAP instance running at a PU is 
called the PU's ASAP endpoint. 

Each time a PU sends a message to a pool that contains more 
25 than one PEs, the PU's ASAP endpoint must select one of the 
PEs in the pool as the receiver of the current message. The 
selection is done in the PU according to the current server 
selection policy (SSP) . Four basic SSPs are currently being 
discussed to use with ASAP, namely, the Round Robin, Least 
30 Used, Least Used With Degradation and Weighted Round Robin, 
see R. R. Stewart, Q. Xie: Aggregate Server Access Protocol 
(ASAP), <draft-ietf-rserpool-asap-08 • txt>, October 21, 2003. 

The simplified example sequence diagram in Fig. 2 schemati- 
35 cally illustrates the event sequence when the PU's ASAP end- 
point does a cache population [Stewart & Xie] for a given 
pool name and selects a PE according to the state of the art. 
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Cache population (update) means updating of the local name 
cache with the latest name-to-address mapping data as re- 
trieved by the ENRP server. 

5 The steps shown in Fig. 2 are explained as follows: 

SI: The ASAP endpoint of the PU sends a NAME RESOLUTION query 
to the ENRP server asking for all information about the given 
pool name . 

10 

S2: The ENRP server receives the query and locates the data- 
base entry for the particular pool name. The ENRP server ex- 
tracts the transport addresses information from the database 
entry. 

15 

S3: The ENRP server creates a NAME RESOLUTION RESPONSE in 
which the transport addresses of the PEs are inserted. The 
ENRP server sends the NAME RESOLUTION RESPONSE to the PU. 

20 S4: The ASAP endpoint of the PU populates (updates) its local 
name cache with the transport addresses information on the 
pool name . 

S5: The PU selects one of the Pool Elements of the Server 
25 Pool, based on the received address information. 

Eventually, the PU accesses the selected Server for making 
use of the service/s. 

30 The existing static server selection policies use predefined 
schemes for selecting servers. Examples of static SSPs are: 

- Round Robin is a cyclic policy, where servers are se- 
lected in sequential fashion until the initially se- 
35 lected server is selected again; 
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- Weighted Round Robin is a simple extension of round 
robin. It assigns a certain weight to each server. The 
weight indicates the server's processing capacity. 

5 The unawareness of dynamic system states leads to low com- 
plexity, however, at the expense of degrading performance and 
service dependability. Adaptive (dynamic) SSPs make decisions 
based on changes in the system state and dynamic estimation 
of the best server. Examples of dynamic SSPs are: 

10 

- Least Used SSP: In this SSP, each server's load is moni- 
tored by the client (PU) . Based on monitoring the loads of 
the servers, each server is assigned the so-called policy 
value, which is proportional to the server's load. According 

15 to the least used SSP, the server with the lowest policy 

value is selected as the receiver of the current message. It 
is important to note that this SSP implies that the same 
server is always selected until the policy values of the 
servers are updated and changed. 

20 

- Least Used With Degradation SSP is the same as the least 
used SSP with one exception. Namely, each time the server 
with the lowest policy value is selected from the server set, 
its policy value is incremented. Thus, this server may no 

25 longer have the lowest policy value in the server set. This 
heads the least used with degradation SSP towards the round 
robin SSP over time. Every update of the policy values of the 
servers brings the SSP back to least used with degradation. 

30 The effectiveness of a dynamic SSP critically depends on the 
metric that is used to evaluate the best server. The research 
on SSPs has been mainly focused on the replicated Web server 
systems. In such systems, the typical metrics are based on 
server proximity including geographic distance, number of 

35 hops to each server, round trip time (RTT) und HTTP response 
times. While SSPs in Web systems aim to provide high through- 
put and small service latency, for example session control 
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protocols such as SIP deal with messages being rather small 
in size (500 bytes on average) . Thus, throughput is not an as 
significant metric as in the Web systems. To the best of the 
author's knowledge, SSPs have not been extensively investi- 
5 gated with, for example, the session control systems. 

In light of the aforementioned state of the art, it is an ob- 
ject of the present invention to propose a method of provid- 
ing a server function in support of a service or a set of 

10 services, such as internet-based applications, the server 

function provided by a Server Pool with one or more Pool Ele- 
ments, each of the Pool Elements being capable of supporting 
the service/s, where the reliability and availability of the 
server function is improved over the existing methods, as 

15 well as to propose a name server and a pool user device im- 
plementing such a method. 

This problem is solved by a method with the feature combina- 
tion as specified in claim 1 and by a name server and a pool 
20 user device as specified in claim 12 or 15, respectively. 

One of the fundamental ideas underlying the present invention 
is to make use of the message exchange between pool user and 
name server to provide the pool user with (additional) status 
25 information related to the pool elements from the name 

server. As the name server is a node dedicated to the server 
pool, in general it will possess better information concern- 
ing the status of the pool elements, regarding for example 
their current status as based on recent Keep-Alive-Messages. 

30 

At least the name server has additional status information at 
its disposal which, if provided to the pool user, in general 
offers the chance to make selection decisions resulting in 
improved performance, reliability and higher availability of 
35 the server functions to be performed by the elements of the 
server pool. Herewith the response times as well as load 
situations of the server pool can be optimized. 
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Furthermore, it is easily possible to provide to the server 
selection module of the pool user the status information from 
the name server, as in any case a message exchange is re- 
5 quired for the pool user to retrieve the transport addresses 
of the pool elements. 

The invention described herein thus proposes basically an 
RSerPool protocol extension, wherein the corresponding exten- 
10 sion of the RSerPool architecture can easily be implemented 
on the name server and the Pool User. 

According to the invention, failure-detection mechanisms are 
distributed in the pool user and the name server. The pool 
15 user makes use of the application layer and transport layer 
timers to detect transport failure, while name servers pro- 
vide the keep-alive mechanism to periodically monitor PE's 
health. 

20 The invention will be further described with respect to a 

particular server selection policy called Maximum Availabil- 
ity SSP (MA-SSP) , which is subject to a separate application 
of the applicant. The invention is however not limited to 
that MA-SSP but can be based on any static or dynamic SSP 

25 which is known or to be developed in the future. 

The MA-SSP operates with the so-called status vector. Accord- 
ing to the MA-SSP, a status vector is of size N (i.e., equal 
to the number of pool elements in a given server pool) and is 
30 defined as follows: 

P = tPlr P2r • - • r Pn] 

A certain element in the status vector represents the last 
35 known status moment of the particular PE. If the last PE's 
status was ON (up) , the time value is stored in the status 
vector unchanged. If the last PE's status was OFF (down), the 
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time value is stored in the status vector with a negative 
sign. The MA algorithm always selects the PE that has the 
maximum value in the status vector. 

5 The PU's ASAP endpoint accomplishes the updating of its 

status vector. Hereafter, the PU's status vector is denoted 
as p (u) . According to the original RSerPool specification 
[Tuexen et al.; Stewart & Xie] , a name server returns the 
transport addresses of the pool servers. In order to smoothly 
10 integrate for example the MA-SSP into the RSerPool architec- 
ture, an RSerPool extension is specified. This RSerPool ex- 
tension, which can be used for other SSPs in rather the same 
way, is described in the following text. 

15 The extension in RSerPool affects the communication between a 
PU and NS, namely, the NS 1 s and the PU f s ASAP endpoint. It is 
assumed here for illustrative purposes that both the PU and 
the ENRP server employ the MA algorithm. The MA algorithm in 
the ENRP server creates a status vector for each server pool. 

20 This status vector is updated periodically by using the ex- 
isting ASAP ' s keep-alive mechanism [Stewart & Xie]. We will 
hereafter denote the name server's status vector as p< s) . The 
p (s) vector for a given pool is stored in the same database 
entry in the name server reserved for that pool. We will as- 

25 sume that there are N pool elements in the pool. 

A PU initiates cache population in the following two cases: 

1) The PU wants to accomplish a cache population (update) 
in order to refresh its p (u) vector with the newest in- 

30 formation from the name server. 

2) The PU wants to resolve a pool name. 

In either case, the PU's ASAP endpoint sends a NAME 
RESOLUTION query to the ENRP server via ASAP. The ENRP server 
35 receives the query, and locates the database entry for the 

particular pool name. The database entry contains the latest 
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version of the p (s) vector. The ENRP server accomplishes the 
following actions : 



1) 



2) 



3) 



4) 



The ENRP server extracts the transport addresses infor- 
mation from the database entry. 

The ENRP server extracts the p (s) vector from the data- 
base entry. 

The ENRP server creates a NAME RESOLUTION RESPONSE in 
which the transport addresses of the PEs are inserted. 
In addition to the transport addresses information, the 
name response is extended with an extra field. The p (s) 
vector is inserted into that extra field. 
The ENRP server sends the NAME RESOLUTION RESPONSE to 
the PU. 



Thus, the NAME RESOLUTION RESPONSE contains the most up-to- 
date version of the ENRP server's p (s) vector. Once the PU re 
ceives the NAME RESOLUTION RESPONSE, it updates the local 
name cache (transport addresses information) as w^ll as its 
p(u) vector. The procedure for updating the PU's ASAP p 
vector is as follows: 
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respectively. 



It should be noted that this works well under the condition 
of synchronized time clocks in pool users and name servers. 
This becomes an issue if the inter-clock drifts are intolera- 
bly large. Employing a clock synchronization protocol such as 
the network time protocol (NTP) eliminates this problem. 

Advantageously, the protocol extension of RSerPool required 
for implementing the invention is rather simple and easy-to- 



8 



WO 2006/002660 



PCT/EP2004/007050 



introduce in RSerPool . Furthermore, the protocol extension is 
transparent to the application layer in the PU, i.e. the cli- 
ent. The status vector is handled at the ASAP layer of the PU 
protocol stack. Thus, the protocol extension is transparent 
5 to the application layer above the ASAP layer. 

Each PU supporting this protocol extension benefits from the 
performance improvements provided by the invention. 

Further aspects and advantages of the invention can be de- 
10 rived from the dependent claims as well as the subsequent de- 
scription of an embodiment of the invention with respect to 
the appended drawings, showing: 

Fig. 1 (discussed above) as a simplified block diagram the 
15 general RSerPool architecture according to the 

state of the art; 

Fig. 2 (discussed above) a simplified sequence diagram il- 
lustrating a message exchange between pool user and 
20 name server from Fig. 1 according to the state of 

the art; 

Fig. 3 a sequence diagram as in Fig. 2, illustrating a 

message exchange between name server and pool user 
25 according to an embodiment of the inventive method; 

Fig. 4 a block diagram showing the essential functional 

blocks of name server and pool user device relevant 
for implementing the embodiment of the invention 
30 illustrated in Fig. 3. 

A schematic drawing summarizing the basic principle of the 
invention is shown in Fig. 3. The steps SI - S4 for the cache 
population as defined in this invention are explained as fol- 
35 lows: 
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1) Sending of a NAME RESOLUTION query from the ASAP end- 
point of a Pool User PU to a name or ENRP server NS, 
asking for all information about a given pool name. 

2) Receiving of the query, and locating of a database en- 
try for the particular pool name by the name server NS, 
The name server NS extracts from the database entry the 
transport addresses information as well as the p (s) vec- 
tor . 

3) Creating a NAME RESOLUTION RESPONSE, in which the 
transport addresses of the PEs and the p (s) vector are 
inserted, by the name server NS. The name server NS 
sends the NAME RESOLUTION RESPONSE to the pool user PU. 

4) Cache population (Updating) of its local name cache by 
the ASAP endpoint of the pool user PU with the trans- 
port addresses information on the pool name. The pool 
user's ASAP endpoint applies the simple procedure de- 
scribed above in equation (1) to update the status vec- 
tor p (u) . 

5) Selection of a particular pool element or server for 
sending a service request to. 

The implementation of the inventive method can be performed 
quite straightforwardly. The NAME RESOLUTION RESPONSE is ex- 
tended with a separate field that contains the status vector 
p (s) . Fig. 4 shows the principal functional components of the 
pool user PU and name server NS, the latter being associated 
to a Server Pool SP with two Pool Elements PE illustrated. 

The name server NS comprises a pool resolution server module 
10, an element status module 12 and a memory 14. The element 
status module 12 periodically assembles Endpoint_Keep_Alive- 
messages according to the IETF ASAP Protocol [Stewart & Xie] 
and sends these messages to each of the servers PE1, PE2 . 
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Assuming the server PE1 being in the operational status M up" 
(server PE1 is ready to provide a server function on request 
of, for example, the client PU) , server PE1 responds to the 
5 Keep-Alive-Message from the server NS by sending an End- 
point_Keep__Alive_Ack-message back to the name server NS . 

Assuming further the server PE2 being in the operational 
status "down" (server PE2 is not ready for service) , server 
10 PE2 does not respond to the Keep-Alive-Message from the name 
server NS thereby the local timer initiated for that Keep- 
Alive-Message at the name server NS expires according to the 
IETF ASAP Protocol. 



15 The element status module 12 maintains a status vector, which 
is stored in the memory 14. The vector contains for each ele- 
ment PE1, PE2 of the Pool SP a number representing a time- 
stamp, which indicates the time of processing of the response 
of each of the elements to the Keep-Alive-Message. The Keep- 

20 Alive-Ack-Message received from PE1 thus leads the module 12 
to write a timestamp A A8C0' (hex) into the position of the 
status vector provided for server PEl, assuming the Ack- 
Message has been processed at twelve o'clock as measured by a 
clock unit (not shown) in the name server and the timestamp 

25 accuracy is in units of seconds. The Unreachable-Message re- 
ceived from PEl leads the module 12 to write a timestamp 
A8C1' (hex) into the position of the status vector provided 
for server PE2, assuming the Unreachable-Message has been 
processed around one second after twelve o'clock. 

30 

The functionality of the server module 10 is described below 
in more detail with regard to a request from the Pool User 
PU. The Pool User PU comprises a pool resolution client mod- 
ule 16, a server selection module 18, a memory 20 and a 
35 server availability module 22. 
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The pool user PU is implemented on a mobile device (not 
shown) capable for data and voice communication via a UMTS- 
network, the server pool SP and name server NS being parts 
thereof. An application of the device wants to access a 
5 service provided by any one of the servers of the Pool SP . 

In this example, the server pool SP is a farm or set of sev- 
ers implementing services related to the IMS (IP Multimedia 
Subsystem) -domain of the UMTS network. The application is 
for example a SIP-based application. 

10 

To request a particular service, only the Pool Name is known 
to an application running on the mobile device (not shown) . 
The application triggers the Pool User part (comprising the 
ASAP endpoint) of the mobile device by handing over the Pool 
15 Name. The pool resolution client module assembles a 

Name_Resolution-Message according to the ASAP protocol and 
sends it to the name server NS (step SI in Fig. 3) . 

The Name__Re solution -Message is received in the name server 
20 NS by the pool resolution server module 10. The pool name is 
extracted and the server module 10 accesses the memory 14 to 
extract the address information which is stored associated 
to the Pool Name. In the example, the IP-addresses of the 
pool elements PE1 , PE2 are read from the memory 14, in con- 
25 junction with the port address to be used for requesting the 
particular service, and, according to the invention, also 
the timestamps ^ASCO' , '-A8C1' stored in association to the 
servers PE1, PE2 are read from the memory 14. The step S2 of 
Fig. 3 is then finished. 

30 

The server module 10 assembles a Name_Resolution_Response- 
Message according to the IETF ASAP protocol, which contains 
the Name Resolution List with the transport addresses of 
PEl, PE2, as is known in the art. Further, a status vector 
35 is appended to the transport address information part of the 
Response-message. The vector comprises in this example the 
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two time stamp-based status-elements for the pool servers 
PE1, PE2. 

The Response-Message is being sent to the sender of the re- 
5 quest (step S3 in Fig. 3) , i.e. to the client module 16 of 
the Pool User PU . After receiving the Response-Message, the 
module 16 extracts transport addresses and the status vector 
from the Response-Message and writes the data to the memory 
20. Further, the module hands control over to the server se- 
10 lection module 18. 

To select a particular server for sending the service re- 
quest to (i.e. performing step S5 of Fig. 3), the selection 
module 18 first loads two status vectors into work memory, a 
15 first one which has been determined by the server availabil- 
ity module 22, the second one being the status vector re- 
ceived from the name server as described above. 

The server availability module 22 determines status informa- 
20 tion related to an availability of one or more of the Pool 
Elements and accesses the memory 2 0 to write the status in- 
formation thereto. In particular, the module 22 determines 
a positive timestamp value for each time, a timer for a mes- 
sage transaction on transport and on application layer does 
25 not expire, i.e. the respective transaction has been success- 
fully completed by reception of an acknowledgment, response 
or other reaction from the Pool Server. In case a timer re- 
lated to a transport or application connection to a server 
expires (i.e. no answer received in time), the negative of 
30 the current timestamp value at timer expiry is written to the 
first status vector determined locally by the availability 
module 22. 

As mentioned above, the selection module 18 loads both status 
35 vectors. Next, the module 18 determines an updated local 
status vector by replacing each entry in the local status 
value with the corresponding value of the name server status 



13 



WO 2006/002660 



PCT/EP2004/007050 



vector, in case this corresponding value in absolute terms 
(i.e., ignoring a sign) is higher, which means, that the 

status measurement by the name server is more up-to-date, 
i.e. has been performed more recently, than the status meas- 
5 urement performed locally by the availability module 22. 

As an example, the stored local (first) status vector might 
represent the status of PE1 at 11:50 (unreachable) and 11:55 
(reachable), i.e. <-A668, A794>, then the local vector is up- 
10 dated in both positions, resulting in <A8C0, -A8C1>. 

The updated vector is written back to the memory into the po- 
sition of the local vector. The storage position for the vec- 
tor received from the name server NS might be used for dif- 
15 ferent purposes inside the mobile device. 

In a further step (step 5 in Fig. 3) , the server selection 
module 18 determines the server to be selected by evaluating 
the highest value in the updated status vector. In this exam- 

20 pie, the highest value is ^ASCO' , being stored in the posi- 
tion denoting the pool element PE1. Thus the module 18 cre- 
ates a pointer pointing towards the storage position inside 
the memory 20 containing the transport address and further 
data, such as port address, related to PE1, and returns this 

25 pointer back to the calling application to enable it to re- 
quest the service from PEl. 

The specific example described herein illustrates just one 
appropriate embodiment of the invention. Within the scope of 
30 the invention, which is exclusively specified by the appended 
claims, by skilled action many further embodiments are possi- 
ble. 

For example, the devices and modules as described herein may 
35 be implemented as Hardware or Firmware. Preferably, however, 
they are implemented as Software. For example, the Pool User 
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device comprising the or any further modules as described 
above may be implemented on a mobile device as an applet. 
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